RC 003 234 



ED 027 123 



DOCUMENT RESUME 



r By'MacArthur, R.S. 

| Assessing the Intellectual Ability of Indian and Metis Pupils at Ft. Simpson* N.W.T. 

| Canadian Dept, of Northern Affairs and National Resources* Ottawa (Ontario). 

| Pub Date Aug 62 
f Note"29p. 

I EDRS Price MF *$0.25 HC-$i.55 

j Descriptors - * Ability, *American Indians, *Cultural Factors, *Group Intelligence Testing, * Intelligence, Social 

I Factors, Socioeconomic Status, Statistical Analysis, Verbal Ability 

I Identifiers'* Metis, Northwest Territory, Progressive Matrices Test, Safran Culture Reduced Intelligence Test 

j The study assessed the general intellectual ability of Indian and Metis pupils of 

| the Northwest Territory (N.W.T.), Canada. While minimizing cultural bias, an attempt was 

| made to identify economical tests for this cultural group which would demonstrate (1) 

j minimal loading on verbal and other culture-bound factors, (2) moderate relationship 

j to school achievement, and (3) relative insensitivity to age. The sample for this study 

| consisted of 239 Indians or Metis of both sexes attending school in Grades 1 to 9 at 

J Ft. Simpson, N.W.T. It was found that the Progressive Matrices Test and the Safran 

! Culture-Reduced Intelligence Test best met the criteria established for 

j culture-reduced measures of intellectual potential; however, it was concluded that the 

I production of norms appropriate to the Indian-Metis would be essential before 

| putting these tests into general use. (JM) 



> 







^00 3234 EDO 27123 f 



■ 



,. . <t ^ .^-' ‘ *’’►.«( ^^/iWMVWprs'-t n^ •>,#»»♦- 







assessing the Intelleitoel ability 
of Indion end metis Pepils 
nt Port Simpson a.Ul.T. 




A Report by 
DR. R.S. MAC ARTHUR 



University of Alberta 



CURRICULUM SECTION 
Education Division 
Northern Administration Branch 




fratasa* 




U.S. DEPARTMENT OF HEALTH, EDUCATION & WELFARE 
OFFICE OF EDUCATION 




} 



THIS DOCUMENT HAS BEEN REPRODUCED EXACTLY AS RECEIVED FROM THE 
PERSON OR ORGANIZATION ORIGINATING IT. POINTS OF VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRESENT OFFICIAL OFFICE OF EDUCATION 
POSITION OR POLICY. 



ASSESSING THE INTELLECTUAL ABILITY OF INDIAN 
AND METIS PUPILS AT FT. SIMPSON, N.V.T, 



A Report by Dr. R •$. MacArthur 
of the University of Alberta on a 
study conducted at the request of 
the Education Division, Department 
of Northern Affairs and National 

Resources 



Curriculum Section - Education Division 
Northern Administration Branch 
Deoartment of Northern Affairs and National Resources 

Ottawa, August, 1962 



% 


























I 










TABLE OF CONTENTS 



SECTION 

A. THE PROBLEM 

B. RATIONALE 

C. DATA COLLECTION 

(a) The Sample 

(b) The Tests 

D. ANALYSIS AND INTERPRETATION 

(a) The Factor Analyses 

(b) Relative Bias against Indian -Metis 

(c) Relationship with School Achievement 

(d) Change with Age 

(e) Other Criteria 

(f) Assessed I.Q.*s of Individual Pupils 
E« SUMMARY 

F. CONCLUSIONS 
REFERENCES 



PAGE 

1 

2 

3 

3 

5 

6 
6 

12 

1U 

15 






15 



16 



18 

21 

22 







FOREWORD 




Reported herein is a study entitled "Assessing the 
Intellectual Ability of Indian and Metis Pupils at Fort Simpson, 
N.W.T •" This study was conducted by Dr. R.5. MacArthur , Professor, 
of Educational Psychology at the University of Alberta, at the 
request of the Education Division of the Department of Northern 
Affairs and National Resources* 



Previous to this study, Mr. D*J.S* Jackson, the 
Education Division specialist in Measurement and Evaluation, • > * 
had undertaken preliminary work toward the selection of a suitable 
intelligence test for use in our northern schools. A thorough 
review was made of the available pertinent literature along with 
a careful examination of appropriate studies carried out elsewhere. 
Keeping in mind certain criteria for test selection, several tests 
which appeared to have some potential for use in >ur schools were 

found* 



Concurrent with Mr. Jackson 1 s work in this field, 

Dr« MacArthur was conducting studies on the general problem of 
measuring the intelligence of pupils who, in one or more ways, 
cannot be satisfactorily tested through the use of conventional 
intelligence tests. Some of the tests used by Dr. MacArthur were 
the same as those which had interested the Education Division. For 
this reason, and because Dr* MacArthur is recognized as being one 
of Canada*s outstanding scholars in his field, he was asked by the 
Education Division to undertake the study reported here. Mr. Jackson 
acted in a liaison capacity for the Department* 



A report on a subject of this nature must, of necessity, 
be technical and the reader will soon discover that reference is 
made to statistical procedures which are unfamiliar to most teachers 
and laymen* Nevertheless, the report contains much of general in- 
terest that can be readily understood by anyone. In particular, 
the sections on "the Problem", "Rationale", "Summary" and "Con— 
culsions" should prove of considerable interest* 



As can be seen from this report, a few "Culture-reduced" 
intelligence tests have been determined, on the basis of the 
accumulated evidence to date, as being among the best available 
for use in our schools* It is interesting to note that the test 
which headed the independently prepared list referred to above is 
also the test which appears to have the greatest potential as 
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evidenced by Dr. MacArthur' s study. However, this is qualified 
to some extent by the fact that for any test to be of value, 
adequate norms must be establish ed# Accordingly, steps have 
been taken to norm three potentially suitable tests. At the 
time of writing it appears that adequate norms will be produced 
during the 1962-63 school year for one of these tests for use 
in the Mackenzie District* 

Dr s MacArthur has placed a quotation in his report 
at the bottom of page 17 which has much significance for our 
teachers. 



Considering the 239 Indian-Metis in this part 
of the study, in 99 cases the Assessed Culture- 
Reduced I.Q. exceeded the Assessed Conventional 
I.Q. by 16 points or more, in 25 cases by 32 
points or more. Twenty Indian-Metis, though 
appearing average on the Conventional Tests, 
appear quite clearly to have potential for uni- 
versity study on the Culture-Reduced Tests; 
this information doesn't tell us what to do with 
these people, but at least it has helped us to 
locate them, 

When suitable tests are administered to other pupils 
the resulting scores, based on adequate norms, will identify 
many as possessing potential for university or other post- 
secondary education. As Dr, MacArthur mentions, the mere iden- 
tification of such pupils does not tell us what they should be 
taught or by what methods. Teachers should do everything 
possible to ensure that our high-potential students are given 
the background necessary for success in advanced work. We will 
be most pleased to learn of the "adaptive treatments" which our 
teachers find to be the most successful. Further, teachers 
experiencing difficulties in teaching these brighter pupils 
should not hesitate to seek the assistance of their principal and 
superintendent „ 

Dr. MacArthur suggests additional research that could 
very profitably be undertaken. Some of this will be carried 
out as time and facilities permit. In passing, it may not be 
inappropriate to suggest that any teacher with an interest in 
this general field might make this interest known. It may be 
possible to offer some assistance to those who wish to conduct 
appropriate studies for thesis or other purposes. 

We acknowledge with gratitude the co-operation of the 
Fort Simpson staff in administering the tests for Dr. MacArthur' s 
study and in supplying other necessary data. 
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The Department of Northern Affairs and National 
Resources is deeply indebted to Dr. Mac Arthur for his thorough 
and scholarly study. Already it has proven to be of much be- 
nefit because of the light that it has shed in an otherwise dark 
and foreboding area. 





B* Thorsteinsson, 

Chief, Education Division, 
Northern Administration Branch, 
Department of Northern Affairs 
and National Resources, 
Ottawa, August, 1962* 
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Department of Northern Affairs and National Resources, 
July, 1962) 



A. THE PROBLEM 

Canadian philosophies of education usually expect instruction in 



schools, especially up to legal school-leaving age, to be so adapted 

as to adequately capitalize on the intellectual potential of individual 

pupils* Such adaptive teaching requires an economical but valid 

assessment of that potential. For pupils from middle-class urban 

cultures reasonably valid instruments such as the highly verbal Stanford - 

Binet intelligence Scales or the conventional group intelligence tests j 

j 

derived therefrom are available for this purpose. But how can a teacher j 

j 

gain a valid picture of the general intellectual capability of an j 

immigrant, a slum child, an Indian or Metis, to assist in diagnosing 

his difficult! e s in reading or number, and in applying teaching j 

I 

techniques appropriately adapted to that capability? ] 

The study herein reported is one in a series concerned with the 

; 

assessment of general intellectual ability with minimum cultural bias. j 



As a replication of another study carried out concurrently at Faust, 
Alberta, it sought to identify economical tests which for the Indian and 
Metis pupils attending school at Ft. Simpson, N.W.T. would demonstrate: 
(a) that the tests were in fact measuring a broad aspect of 
intelligence common to a wide variety of mental tasks, while at the same 
having minimal loading on verbal and other factors oriented toward 
a particular culture* 
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(b) that the tests were doing ao with leas bias against the Indian- 
Metis than that of commonly-used so-called intelligence tests, 

(c) that they were moderately related to school achievement, and 

(d) that they were showing less change in score with age, relative 
to white pupil performance, than were conventional intelligence tests* 

As a by-product of the study, some data were obtained concerning the 
intellectual potential of individual pupils in the sample as assessed by 
the tests best meeting these criteria. 



B. RATIONALE 




Brief exposition of the rationale underlying the adoption of 
criteria for selecting tests of intellectual potential for culturally- 
handicapped pupils may be in order* For purposes of this series of studies, 
Intelligence is conceived as hierarchical in structure, with general in- 
tellectual ability, similar to Spearman's g, at the top of the hierarchy. 
Further down in the hierarchy are group factors or primary mental abilities, 
such as verbal, numerical, and spatial abilities, of various degrees of 
generality depending upon the tasks and persons used in defining them* 
Individual differences in abilities result from the interaction of innate 
predispositions and environment in a multiplicative rather than an additive 
manner* Sensory-motor and perceptual associations of early childhood are 
important in forming the essential bases of all cognitive abilities, but 
general intellectual ability, which may be explained in terms of extensive 
positive transfer of learnings, may be less influenced than abilities lower 
in the hierarchy by particular learnings from the environment. 

When curricula and teaching methods are relatively fixed and we are 
predicting success in attaining immediate and specific goals such as end -of - 
next-year school examinations, empirical predictor-goal correlations and 
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expectancy tables, without theorizing about what is being measured, are quite 
satisfactory , But if we can implement a philosophy calling for curricula and 
teaching methods so adapted as to maximize realization of the intellectual 
potential of individual oupils, and we are predicting success in attaining 
distant and general goals of adult life, theoretical consideration of the 
constructs likely to be involved in predictor-goal relationships becomes vye- 
ful, perhaps definitely riecessaiy, A distinction is here being drawn between 
prediction to immediate and specific goals with relatively fixed intervening 
treatment on the one hand, and prediction to distant and general goals with 
relatively adaptive intervening treatment on the other, while a philosophy 
of elementary and junior high school education entailing the latter is being 
assumed 9 

Bringing the foregoing two paragraphs together implies that tests of 
intellectual potential for culturally-handicapped pupils, as aids to future 
adaptive teaching, should samole the general intellectual ability factor g. 
However, for such pupils this factor may not be representatively sampled 
through the school achievement, verbal reasoning in English, and English 
vocabulary usually forming the content of intelligence tests. Media less 
dependent upon particular learnings should better allow pupils from cultures 
other than middle-class urban white to demonstrate their intellectual cap- 
abilities, Nevertheless, if pupils have had sufficient contact with school 
and other aspects of white culture to enable them to sit for group intelli- 
gence tests, such tests should have positive, though perhaps low, relation- 
ship with concurrent school achievement, since g is common to both the tests 
and school achievements 

Co DATA COLLECTION 

(a) The Sample , The sample for this study consisted of 239 Indians or 
Metis of both sexes attending school in Grades 1 to 9 at Ft. Simpson, liiW.T. 



lx 



in October of 1961, An Indian-Metis was simply defined as any pupil who in 
the opinion of his teachers was considered by the community "to have Indian 
blood in his veins"; In the analysis no distinction is made between Indian 
and Metis, both of whom are hereafter referred to as Indian-Metis* The 
socioeconomic status of the sample was very low, as indicated by its Blishen 
Occupational Index of mean 3*> and standard deviation U.2 (for Canada mean is 
£0 and standard deviation is 10), A language other than English (Slave, with 
some Dogrib, French and Chipewyan) was used in the home on the average "most 
of the time,” 

Data are herein presented for four separate groups in the sample* 

(a) Grade 7, 8 and 9« 32 pupils of mean age 13-10 

(b) Grade £ and 6, £8 pupils of mean age 13-11, Included in this group 
were a class called a Vocational class, and another called a Pre-vocational 
class, both of which included older pupils doing school work well below the 
Grade 7 level* 

(c) Grade 2 and 3* 1*6 pupils of mean age 10-2, 

(d) Grade 1* 19 pupils of mean age 7-6. 

Grade It is omitted since complete comparable data for a white sample 
were not available. Also omitted are a Basic English class, a sight-saving 
class, those Grade l's who, having been in school only a few months, could not 
cope with some of the tests, and a few additional pupils in other grades for 
whom complete test scores were not available because of absence. The original 
sample of 239 is thus reduced to a total of l££ for purposes of this analysis. 

Data as of May, 1961 for the four comparable groups of Indian-Metis in 
the Faust study are included in this report. The similarity of the results 
for these two samples, of different tribal affiliations and living £00 miles 
apart, is striking. Since for both samples the number of cases in each group 
is small, replication has increased considerably the confidence which c an be 
placed in the results. 
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(b) The Tests * In October of 1961, appropriate levels of a number of 
tests of intellectual ability which were hypothesized as '‘culture -reduced” 
were administered to the Ft, Simpson pupils by their regular classroom 
teachers,* under the supervision of the writer. These "culture-reduced” tests 
required the pupils to reason, to learn and adapt as they went along, to form 
concepts, to see relationships and Drinciples, and to use these principles in 
problems. But they did so through the media of simple desipns such as squares, 
triangles, and circles rather than through verbal problems or pictures of 
objects from an urban environment, At the same time several conventional 
intelligence tests were administered, and in December 1961 a number of 
measures of school achievement were obtained. The actual tests used for the 
four groups are given below l 

Grade 7, 8, and 9 - 

1, Standard Progressive Matrices (1956)* 

2, IPAT Cattell Test of ”g w , Scale 2 (19U9). 

3, Lorge=Thorndike Non-Verbal Intelligence Tests, level U (195U)* 

U, Safran Culture -Reduced Intelligence Test (i960), 

5, California Short -Form Test of Mental Maturity, Elementary (1957)# 
Non-Lanpuape and Language parts# 

6, Otis Quick -Scoring Mental Ability Tests Beta (195>li)* 

7, California Achievement Battery, Junior High (1957), Reading, 

Arithmetic and Language parts. 

Grade 5 and 6 - 




1, Standard Progressive Matrices (1956), 

2, IPAT Cattell Test of V% Scale 2 (19U9)# 

3, Lor ge -Thorndike Non-Verbal Intelligence Tests, Level 3 (195U)# 
ii< Safran Culture -Reduced Intelligence Test (i960), 

5# California Short -Form Test of Mental Maturity, Elementary (1957)* 
Non-Language and Language parts# 

6, Otis Quick-Scoring Mental Ability Tests, Beta (195U)« 

7# California Achievement Battery, Elementary, (1957), Reading, 
Arithmetic and Language parts. 



EMC 



Grade 2 and 3 - 



1 * 
2 4 

3- 

a* 



Coloured Progressive Matrices ( 19)-i7 ) * 

Lor ge -Thorndike Intelligence Tests, Level 2 (19$k)» 

Safran Culture -Reduced Intelligence Test (i960), 

California Short -Form Test of Mental Maturity, Primary (1953)* 
Non-Language and Language parts. 
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Otis Quick -Scoring Mental Ability Tests, Aljha Short Form 
(1952), Non-Verbal and Verbal parts# 

6, California Achievement Battery, Upper Primary for Grade 3> 
Lower Primary for Grade 2 (1957)# Reading, Arithmetic and 
Language parts* 

Grade 1 - 

It Coloured Progressive Matrices (19h7). 

2 Lor ge -Thorndike Intelligence Tests* Level 1 (195U)# 

3» Safran Culture-Reduced Intelligence Test (I960), 
lj ; California Short-Form Test of Mental Maturity, Pre-Primary 
(1957)# Non-Language and Language parts. 

5 Detroit Beginning First-Grade Intelligence Test (1937). 

6: California Achievement Battery, Lower Primary (1957). 

Reading, Arithmetic, and Language oarts. 



D, ANALYSIS AND INTERPRETATION 



(a) The Factor Analyses . For each of the four groups the inter- 
correlations of the various tests were obtained (after appropriate attention 



to scaling and to shapes of the distributions). These intercorrelations 



were then examined by factor analysis using the University of Alberta’s IBM 



1620 electronic computer, to determine the extent to which common influences 
seemed to be running through the various tests. In these studies factor 
analysis is viewed as just a helpful means of classifying the way persons 
behave in test situations* As with many other classification procedures, 
the same data may often be classified in several ways j the particular class- 
ifications herein selected are ones considered likely to be meaningful and 
useful to teachers and others working with culturally-handicapped pupils in 
school systems, and of course at the same time consistent with the data, 1 
Examination of the rotated factor matrices displayed in Tables I to IV 
provides evidence of the degree to which the various tests for the various 



± Eight principal component factor analyses were Der formed (one for each 
of the four groups at both Ft, Simpson and Faust), using the Jacobi method of 
obtaining eigenvalues and eigenvectors of real symmetric matrices. Unities 
were inserted in the diagonal cells, and factors whose corresponding eigen- 
values were greater than unity were considered significant. One additional 
factor was sometimes retained to assist in the rotations. 

Orthogonal rotations were carried out graphically, using the criteria of 
high variance for a general factor, positive manifold, and psychological 
meaning to assist rotation. 
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age and grade groups can be interpreted as meeting the first criterion of 
measuring a broad aspect of intelligence common to a variety of mental 
tasks (high g loading), while at the same time having minimal loading on 
verbal and other factors oriented toward a particular culture# 

Table I presents the rotated factor matrix for the Grade 7> 8, 9 group 
in both the Ft# Simpson and the Faust sample s# (There were no Grade 9’s 
in Faust)# Since for both samples the N‘s are small, loadings below #3 
are omitted# Test II is the Test of General Ability, administered in 
Faust but not in Ft# Simpson# The similarity of the factor patterns is 
evident# For both samples Factor I is interpreted as the general intellect- 
ual ability factor g, running positively through all of these mental tasks# 
Factor II , running through the verbal and school-like tests resembles closely 
the verbal s educational factor commonly identified by British factor anal- 
ysts, but is likely better labelled a verbal t cultural factor in this context# 
Factor III is clearly a number factor for the Faust sample, but is not in- 
terpretable for the Ft# Simpson sample# The columns headed indicate the 
communalities of the respective tests, each communality having maximum value 
of 1#, and providing an index of the degree to which the test is measuring 
things in common with other tests in the battery# 

Table I shows that for this age and grade group Progressive Matrices, 
the Cattell Test, and SCRIT are highly loaded on the general intellectual 
ability factor, but have negligible loadings on the other group factors# 

The Lorge -Thorndike has quite high g loading, but has some loading on vjcI 
for the Ft# Simoson sample, and some loading on n for the Faust sample* 

In Table II the rotated factor matrix for the Grades $ and 6 samples 
are presented# Again the similarity of pattern for the two samples is 
striking; Factors I and II are clearly g and viol, while Factor III is 
likely a spatial factor labelled k# For the Faust sample a small fourth 
factor, ouite uninterpretable, opposing California language and Reading, 
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TABIE I 

GRADE 7,8,9, ROTATED FACTOR MATRIX 
(Loadings below *3 omitted) 



Ft* Simpson N ■ 30, Mean Age = 13 -10 5 Faust N * 23> Mean Age * lli-U 



Factor 

Sample 

Inter- 

pretat- 

ion 


I 

Simps, 

g 


Faust 

g 


II 

Simps, Faust 
tfsd vjcl 


III 

Simps* Faust 
? n 


h 

Simps# 


2 

Faust 


I* Prog, Mat# T 


.77 


.82 


— 


— 


— 


— 


.61* 


.72 


2 = Cattell T 


.83 


,80 


— 


— 


— 


— 


.77 


#71 


3 , L-Th T 


• 76 


.65 


.39 


— 


— 


#5U 


.77 


#7U 


ll, SCRIT R 


.78 


.90 


- — 


— 


— 


mm m 


.69 


#92 


5. CTMM N-L T 


(.15) 


.69 


— 


— 


.93 


.55 


•9U 


#83 


6 . CTMM Lang. T 


•Uo 


.67 


#82 


.61* 


— 


— 


.87 


#86 


7c Otis R 


.39 


.52 


, 8 U 


.77 


— 


mmm> 


#87 


#87 


6 c Calif. Rdg. 0 


.5U 


.52 


.76 


.72 


— 


— 


#89 


.81 


9. Calif. Arith.G 


.71 


.51 


.bk 

> 


#U 6 


— 


• 

vn 

CO 


#70 


#80 


10c Calif. Lang. 0 


•65 


.51 


GO 

V\ 

% 


.U9 


— 


.59 


#77 


# 8 U 


11. TOGA R 




.37 




.77 




— 




#73 


Prop, Common Var# 


.51 


.53 


.35 


.31 


.ii» 


#16 


1.00 


1.00 


Prop, Total Var, 


.Uo 


•!» 2 


.28 

\ 

1 - - 


.25 




.13 


.79 


.80 



NOTE: In Tables I to IV> indicates T»score based on Calgary or Edmonton 

samples, G indicates grade placement according to publisher's 
norms, and R indicates raw score* 
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was found* Progressive Matrices, Cat tell, Lor ge -Thorndike, and SCRIT all have 
large g loadings and negligible group factor loadings, except for the small k 
loading of Cattell# 

TABLE II 



GRADE 5,6, ROTATED FACTOR MATRIX 
(Loadings below #3 omitted) 

Ft* Simoson N « 58, Mean Age = 13-11 5 Faust N = 29* Mean Age « 12-10 



For the Grade 2 and 3 samples., as indicated by Table III, Factors I and II 
are again clearly the g and v*cl factors# The nature of Factor III is not 
so clear, but the tests having high loadings on this factor, at this grade - 
level, all reouire considerable comprehension of oral English* Progressive 
Matrices, SCRIT, and Otis Non-Verbal all have high g loadings with negligible 
group factor loadings# 




1 

Factor I 
Sample j 
Interoretation i 


I 

Simps • Faust 
g g _ 


II 

Simps • Faust 
v:cl vscl 


III 

Simps • Faust 
K K 


IV 

Faust 

9 

• 


h^ 

Simps# Faust 


1* Prog* Mat* T 


*77 


•8h 


— 


— 


— 


*66 


.80 


\ 

2« Cat tell T 1 

9 


♦73 


*7h 


<m as cm mimam 


.35 


.1*1 


— ! 

i 

| 


.65 


.78 


» 

3* L-Th* T | 

i 


j .87 

i 


,88 


s sc ss am mo mm 




1 

j 


.82 


.83 


Uc SCRIT T 


t 

.77 


.78 | 


1 

caxapoB #»c»a» 

1 


i 


t 

... | 


.67 


.7® 


5. CTMM N-L T 


♦39 

i 


(.19) 


1 


.81* 


.90 


i 


*87 


.91 


o. CTMM Lang. T 


! .31 

• 


.57 


.79 


.51 


i 


— 


.73 


.68 


7. Otis R 


\ 

1 .58 


.hi 


.70 


.66 


— 


.39 


.81* 


.82 


8. Calif. Rdg* G 


| .1*8 


.ItO 


i .78 

1 


•M 


—*•**■• * • •» 


.76 


.87 


.96 


9. Calif .Arith.G 


i 

1 .62 


.82 


*62 — 


— — 


— 


.83 


*76 


10 * Calif* Lang*G 
11* TOGA R 


! .50 (-.09) 

1 .77 


.70 .56 

1 .35 

l 


— — — — — — 


.71 


.75 .91 

.75 


Prop. Common Var. 


1 

; .5i 


.51 


1 *35 

1 


.18 


j ^ 


.15 


.16 


1.00 


1*00 


Prop. Total Var. 


j .39 

1 


•1*2 


1 

! .27 


.15 


1 .u 

4 . 


*12 


.13 


.77 


.82 






I 
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TABLE III 



GRADE 2,3 ROTATED FACTOR MATRIX 
( Loadings below .3 omitted) 



Ft* Simpson N * b6, Mean Age * 10-2} Faust N » U2, Mean Age ■ 9-U 

h 2 

Simps. Faust 



Factor 

Sample 

Interpretat- 
ion 




Simps* Faust ! Simps. Faust 



III 

Simps. Faust 
Compreh, Oral 
Eng. 








||ggg3jj^gggjg|&gaggjjgjjffi^^ 
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TARI£ IV 

I 

I GRADE I ROTATED FACTOR MATRIX 

I (Loadings below .3 omitted) 

j 

| Ft. Simpson N ■ 19, Mean Age ■ 7-6; Faust N ■ 32, Mean Age ■ 7-9 



[ 

[ 

f. 

r 



Factor 

Sample 

Interpretat- 

ion 


I 

Simps « 
g 


Faust 

g 


II 

Simps. 

vscl 


Faust 

Comp. 

Oral Eng* 


h 2 

Simps* 


Faust 


1* Prog* Mat* 


T 


.81* 


.68 


— 


“““ 1 


.72 


.1*7 


2, L-Th. 


T 


.55 


.67 


.50 


.35 


.55 


.57 


3 * SCRIT 


T 


.9h 


.62 


— 


.1*1 


.90 


.55 


ho CTMM N-L 


R 


,72 


(.23) 


.1*9 


.1*0 


.76 


.21 


$ a CTMM Lang. 


R 


*88 


.35 


.33 


.70 


*88 


.57 


6, Detroit 


R 


.56 


(.17) 


.68 


.88 


.78 


.80 


7 . Calif. Rdg. 


G 


*76 


.81* 


.55 


— 


.89 


.76 


8, Calif* Arith. 


G 


.59 


.71* 


.75 


.31 


.92 


.65 


9= Calif, Lang. 


G 


•35 


.86 


.71 




.63 


.76 


10. TOGfc . 


R 


* i* 


.66 


- 


— 


« 


.1*5 


Prop. Common Var. 




•65 


.68 


.35 


.32 


1.00 


1.00 


Prop* Total Var, 




.50 


• 39 


.30 


.19 


.60 


.58 



i: 



: 

l 



For the Grade I samples., Table IV shows only two significant factors, the 
first being g. The second has been labelled vscl for the Ft* Simpson sample, 
and rather dubiously comprehension of oral English for the Faust sample* 
Progressive Matrices and SCRIT both have g loadings with negligible 
group factor loadings for the Ft, Simpson sample, but SCRIT has some loading 
on the second factor for the Faust sample* 
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(b) Relative Bias against Indian-Mstis . To see how well the various 
tests hypothesized as culture -reduced -met -the second criterion, that of 
less bias against the Indian-Metis than that of conventional intelligence 
tests, scores for the tests for which entries appear in Table V were 
obtained on samples totalling 780 pupils representative of Grade 7 pupils 
of Edmonton, and Grades 6, 3, and 1 pupils of Calgary. These were con- 
verted to scaled scores called T— scores, so that the means for the white 
urban groups on these tests were all $ 0 for each test, with standard 









deviations of 10. In effect the tests were all normed on the same 



Edmonton or Calgary groups, with the norms scaled to comparable form* 

By expressing the Indian-Metis scores in terms of these white urban T- 
scores, the cultural bias of the various tests could be compared. Table 
V gives for each of the groups for both the Ft. Simpson and the Faust 
samples, the mean T-scores based on the white urban samples, whose means 



were of course $0 in each instance. The data in this table are extracted 
from the M* Ed* thesis of Mr* Lloyd West# 

For the Grade 7, 8, and 9 samples the asterisks indicate differences 
from the California Test of Mental Maturity Total significant at the *01 
level, as determined by two-way analysis of variance and Duncan's multiple - 
range test. SCRIT scores were not available for the Edmonton sample* For | 

the Ft. Simpson sample, the means of all the other tests hypothesized as I 

culture-reduced differ significantly from that of the conventional CTMM 

t 

Total; the pattern for the Faust sample is similar, although differences j 

for means of the Progressive Matrices and the Cattell Test do not quite i 

: 

reach statistical significance for this group# j 









„ ,SjS. Iffjrf - s -»r i - -1- > J '-* *'»- Air?' - n, p£ Mot , ^ « .- -- 



B*BP 
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TABLE V 



MEAN T-SCORES BASED ON EDMONTON OR CALGARY SAMPLES 
(White urban means are ^0 in each instance) 



i 

! 

t 


Gr. 7, 8, 9 in j 
Edmonton T 

i 


Gr. 5 and 6 in] 
Calgary T 


Gr. 2 and 3 in 
Calgary T 


Gr, 1 in 
Calgary T 


l 

♦ 

i 


Simps, Faust j 

i 


Simps. 


Faust ! 

! 


Simps • Faust 


Simps. 


Faust 


lo 


1 

Prog. Mat. i 

j 




hi i 

j 


ItO* 


37* 


36* 35* 


1>1* 


1)3* 


2c 


i 

Cattell i 


j lilA 


hi i 

i 


39* 


38* 


I 

f 

1 


i 

1 




3* 


L-Th i 

] 


U5* 


1*2* i 

t 


27 


31 


CM 


35* 

l 


39* 


Uo 


SCRIT 




| 


39* 


36* 


I 1*0* 38* 

1 


! Ui* 


1*9* 


5» 


CTMM N-L 


lii* 


l»3* | 






1 

j 

j 






6 c 


CTMM Lang. 


i 30 

j 


33 ' 

} 






1 

1 

1 

j 






7o 


CTMM Total 


! 31 


36 | 

t 






j 21 29 






8c 


Detroit 


♦ 

i 

\ . 








\ 


27 

! 

1 ■■ ■ — 


35 


ASig.Diff .from 
CTMM Total 
; at .01 level 

i 

1 _ _ V 


*Sig.Diff.from 
L-Th. Total 
at .01 level 


*Sig,Diff .from 
i CTMM Total 
j at .01 level 


! ASig.Diff.from 
j Detroit 

i at .01 level 
L 



For the Grade 5 and 6 samples, scores on conventional intelligence 
tests for the complete Calgary sample were not available, so that comparison 
of the culture -reduced tests with a conventional test was not possible* 
Differences for the Progressive Matrices, Cattell, and SCRIT with the Lorge- 
Thorndike are all significant. The bias of the Lorpe -Thorndike which seems 
apparent from the approach of Table V disagrees with the findings of Table 
llj where for both samples this test had the highest g loading, and no 
loading on the verbal {cultural factor. 

For the Grade 2 and 3 samples means for the Matrices and the SCRIT 
differ significantly from those for the conventional CTMM Totals while for 
the Grade I samples means for these two tes^s and for the Lorge-Thorndike 
differ significantly from those for the conventional Detroit. 

This analysis has indicated that the culture -reduced tests, though 







also biased against the Indian-Metis, contain much less bias than do the 
conventional tests with which they were compared, 

(c) Relationship with School Achievement , A culture -reduced test 
may not be expected to show very high correlation with school marks since 
the latter are themselves weighted by language and cultural bias, but such 
correlations should be positive and moderately high. Table VI shows this 
to be the case, where all six of the culture -reduced tests have moderately 
high positive correlations with California Achievement Total, but these 
correlations are generally, though not always, lower than those for 
conventional verbal tests. 



TABLE VI 

CORRELATIONS WITH CALIFORNIA ACHIEVEMENT TOTAL 





Gr, 

Simps - 


8 and 9 
Faust 


Gr 0 5 and 6 
Simps « Faust 


1 

Gr* 2 and 3 
Simps « Faust 


Gr. 1 
Simps, 


Faust 


1, 


Prog, Mat, 


.12 


.60 


.26 


.61 


.31 


.71 


♦55 


.52 


2* 


Cattell 


.38 


.55 


.U1 


.aa 










3: 


L-Th. 


.75 


.63 


.59 


.70 


,66 


.66 


•5U 


.63 


lu 


SCRIT 


•U9 


.29 


.35 


.50 


.as 


,6a 


,U2 


.53 


5* 


CTMM N-L 


.30 


.hh 


.U2 


.21 


,ao 


.59 


.69 


.13 


6 ; 


Obis N-V 




i 






.a5 








7, 


CTMM Lang, 


.77 


.79 


.69 


,68 


.a7 


.76 


.78 


.37 


8> 


CTMM Total 


.78 


.80 


,6U 


.57 


.55 


.77 


.79 


.35 


9. 


Otis 


.77 


.76 


.81 


.76 


.57 








10, 


Otis Verbal 










.a9 








n. 


Detroit 












.aa 


.75 


,02 
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(d) Change with Age * Since this was a cross-sectional study, it was 
not possible to examine the stability of scores on the various tests for 
individual pupils over a period of years# This might be possible at a 
future date# However, some evidence on the comparable stability of scores 
on culture -reduced and on conventional tests over a five-year period was 
obtained through comparing performance of the Grade 2 and 3 group with that 
of the Grade 7, 8 and 9 group on several tests taken by both groups# 

For five conventional tests or sub-tests (CTMM Lang#, CTMM Total, 

CTMM Verbal, CTMM Numerical, CTMM Logical) the mean increase is mean T- 
score from Grade 2, 3 to Grade 7, 8, 9 was obtained. For five culture- 
reduced tests or sub-tests (Progressive Matrices, L®Th# sub-test II, L-Th# 
sub-test III, CTMM N-L, CTMM Spatial) the corresponding mean increase in 
mean T-score from Grade 2, 3 to Grade 7, 8, 9 was obtained# For the Ft. 
Simpson sample the difference between these two mean increases was 7 #9, 
for the Faust sample £.3# For both samples the conventional tests showed 
greater mean increase with increasing age than did the culture-reduced 
tests. (The difference is statistically significant at the #0*> level for 
the Faust sample, but because of greater variance, not for the Ft* Simpson 
sample). The culture -reduced tests are more stable, have been less affected 
by alterations in environment, over the five-year period, than are the 
conventional tfests. 

(e) Other Criteria . No direct reliability studies of the tests used 
in this investigation were made for the samples concerned. One of the 
criteria for initial selection of all tests for inclusion, however^ was 



"The vocabulary of this paragraph is tricky, as are some of the 
assumptions underlying its computations# This procedure, though providing 
evidence concerning relative stability over time, is no proper substitute 
for longitudinal study of individual pupils for this purpose. 
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satisfactory reliability as indicated by studies elsewhere* Minimum 
estimates of reliability for these samples are provided by the coimunal- 
ities quoted in Tables I to IV; the reliabilities may be much higher than 
these coranunalities* but will not be lower. The consistent similarity of 
results for the two different samples* in spite of the small numbers of 
pupils involved in each group* provides general evidence for quite satis- 
factory reliability for all tests reported herein. 

One important criterion for tests for use in such settings is face 
validity - the test should appear to pupils* to teachers* and to interested 
laymen in the community* to be assessing a basic ability to reason, through 
media entailing minimal handicap for such pupils. Progressive Matrices and 
SCRIT appeared best in this connection, esoecially the former, Indian-Metis 
pupils and their teachers found these tests interesting, and a rightful 
skepticism of such studies on the part of interested laymen often dissolved 
if one could get them to themselves start working through Progressive Matrices, 

Of the tests studied, the Standard Progressive Matrices proved to be the 
easiest for classroom teachers to administer. 

One major drawback for all tests included in the study is lack of norms 
appropriate for Indian-Metis of the Canadian North# A raw test -score by 
itself is meaningless to a teacher* a counsellor* or a principal* unless 
there exists some appropriate point of reference with which the score can be 
comoared. Although for most of the tests studied publishers norms exist 
(based on widely differing white groups - from Scotland to United States to 
Calgary), if any of these tests are to be used to assist in assessing the 
intellectual potential of the Indian-Metis* the production of appropriate 
norms is essential, 

(f) Assessed I.Q^s of Individual Pupils , Though the major purpose 
of this investigation was to study tests* rather than to assess the 
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intellectual potential of individual pupils until more was known about the 
tests, some information in the latter connection was obtained, and perhaps 
should be reported. In December, using the various publisher's norms, the 
Intelligence Quotient of each of the 239 Indian-Metis in the Ft. Simpson 
sample was assessed* based on the conventional tests and also based on the 
culture-reduced tests. The two assessed I.Q. S s for each pupil were reported 
to the school principal at that time. 

Table VII presents the mean assessed conventional I.Q. '8 and the mean 
assessed culture -reduced I.Q. 's for the Ft. Simpson and Faust samples. These 
may be compared with theoretical average I.Q. 's of 100 for the country as a 
whole* When it is remembered that it could not be claimed that the culture- 
reduced tests are by any means culture-free when used in this setting, these 



figures present rather strong evidence of considerable intellectual potential 
amongst these Indian-Metis samples. 



TABLE VII 



MEAN ASSESSED INTELLIGENCE QUOTIENTS OF INDIAN-METIS 
(Based on Publishers' Norms with 
M of 100 and S.D. of 16) 



Sample ! 


Ft e Simpson 


1 Faust 


N j 


239 


11*7 


Assessed Conventional I.Q. 


80 


87 


Assessed Culture-Reduced I.Q. 


9U ! 


! 9U 



But perhaps of more practical interest than such statistics are the 



meangings for individual cases. A letter from the writer to the Department 
of Northern Affairs and National Resources concerning the Ft. Simpson sample 
reads in part? 

Considering the 239 Indian-Metis in this part of the study, in 99 
cases the Assessed Culture -Reduced I.Q. exceeded the Assessed Conventional 
I.Q. by 16 points or more, in 2 $ cases by 32 points or more. Twenty 
Indian-Metis, though appearing average on the Conventional tests, appear 
quite clearly to have potential for university study on the Culture-Reduced 
Testsj this information doesn't tell us what to do with these people, but 
at least it has helped us to locate them. 



























E. SUMMARY 
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In October of 1961 a number of tests of intellectual ability hypoth- 
esized as “culture -reduced,” alone with some conventional measures of 
intelligence and achievement, were administered to the Indian-Metis pupils 
attending school at Ft, Simpson, N.W.T., with a view to identifying 
economical measures of intellectual potential having less cultural bias 
than tests commonly used for this purpose. Results are summarized in 
Tables VIII to XI for each of four groups in relation to several criteria 
set up for such culture-reduced tests# 

Since the pattern of results for this Ft, Simpson replication of a 
concurrent study of Indian-Metis pupils at Faust, Alberta, closely 
resembles that for the Faust sample, for summary purposes the figures 
reported below, wherever possible, are weighted means of the respective 
Ft, Simpson and Faust figures. Though in a few instances such combina- 
tion may be questionable, in general it adds clarity to the summary. Data 
for the two samples taken separately have appeared earlier in this report. 



TABLE VIII 

SUMMARY EVALUATION OF FIVE CULTURE-DEDUCED TESTS: 

GRADE 7, 8* 9 SAMPLES 
(N = £3$ Mean Age = 11* -l) 



g Group I Mean T-score j r Calif, 





Criteria 


Loading 


Factors 

l ! 

1 


Based on Edmonton 


j Achiev r Total 


1, 


Prog, Mat* A 


j .79 


I 

i 

None 


f j 

U3 


.50 


2, 


L-Tht A 


| .71 


.39 v:cl S 
.54 n F 


uu 

1 


.70 


3o 


Cattell A 


CM 

GO 

• 


None 


Ui 


OJ 

• 


Ju 


SCRIT 


OO 

• 


None 




.ItO 


£ 


CTMM N-L 


.2.9 i 


i j 

None 


_ h2 


.36 


6, 


CTMM Total 


! ! 
t 

j 1 


1 ; 

1 i 


39 ! 


.79 



ATests best meeting criteria, 
SFt, Simpson sample only, 

F Faust sample only. 
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TABLE XI 



SUMMARY EVALUATION OF FOUR CULTURE -REDUCED TESTS : 

GRADE 1 SAMPLES 
(N = $1; Mean Age = 7-0) 



(5) Detroit 



.32 



.68 v:cl S 



1 — F 

I 

l 

Criteria 


g 

Loading 


Group 

Factors 


Mean T-score 
Based on Calgary 


r Calif. 
Achiev. Total 


a) 


Prog. Mat. A 


♦7h 


None 


hi 

i 


.53 


(2) 


SCRIT A 


#7h 


•hi Oral 


h6 


,U9 






Comp. F 




.60 


(3) 


L-Th# 


.63 


#£0 v:cl S 


30 






•35 Oral 












Comp. F 






ik) 


CTMM N-L 


.hi 


*h9 v:cl S 




•3U 






i #L0 Oral 












! Comp. F 

r 







i .88 Oral 


! 




1 i Comp* F 


32 


#29 



ATests best meeting criteria 

S P 

Ft# Simpson sample only; Faust sample only. 



1. „ The starred tests in Tables VIII to XI, in the order ranked, best meet 
the criteria established for culture -reduced measures of intellectual pot- 
ential for the samples under s tudy. In making such ranking, the criteria 

of high g loading and high T-score were considered most important. 

2. Progressive Matrices is the Single test clearly best meeting the 
criteria over the four groups studied# In addition it has face validity, 
is interesting, and is easy to administer. 

3. SCRIT also meets the criteria well at all levels. Since it is a new 
test still in experimental stages and likely to undergo revision, its wide 
use for the time being might be most effective in the more clinical setting 
of individual testing. It appears to be a very promising culture-reduced 
test of general intellectual .ability# 

U. For the Grade 7, 8 and 9 group the Lor g>e -Thorndike Non-Verbal and the 
Cattell Test of g both rank high; for the Grade 5 and 6 group they may 
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still be satisfactory, though not meeting the criteria as well at this level* 
For the Grade 2 and 3 group the Otis Non-Verbal would appear from the evid- 
ence available to be next-best to Progressive Matrices for group testing at 



this time* 

5, In so far as could be ascertained in a cross-sectional study the culture* 
reduced tests in general appeared less affected by alterations in environment 
over the period Grade 2, 3 to Grade 7, 8, 9* than were the conventional tests 



studied# 



F. CONCLUSIONS 




r 



f 

i 

i 



1, Until further much-needed research can improve upon them, use of 
the starred tests of Tables VIII to XI is recommended in the place of con- 
ventional verbal intelligence tests for assessing the intellectual potential 
of subjects such as those in the samples of this study* 

2* However, before widespread use of these tests is feasible, the 
production of norms aopropriate for the groups with whom they are to be used 
is essential* 

3* Although these tests are still considered to be culturally biased 
when used in this context, they have indicated considerable intellectual 
potential amongst the Indian-Metis of Ft* Simpson and Faust. 

U. Rather clearly indicated seems the need for extensive investigat- 
ion of the means of best adapting treatment of the India>Metis to help 
them better realize the intellectual potential indicated by this study* 
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